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ABSTRACT 


Cumulative  search-evasion  games  (CSEGs)  involve  two  players,  a  searcher  and  an 
evader,  who  move  among  some  finite  set  of  cells.  Neither  player  is  aware  of  the  other 
player's  position  during  any  stage  of  the  game.  When  the  payoff  for  the  game  is  as¬ 
sumed  to  be  the  number  of  times  the  searcher  and  evader  occupy  the  same  cell,  Eagle 
and  Washburn  proposed  two  solution  techniques;  one  by  fictitious  play  and  the  other 
by  solving  equivalent  linear  programming  formulations.  However,  both  have  proved  to 
be  time  consuming  even  for  moderately  sized  problems. 

This  thesis  considers  two  alternate  linear  programming  formulations  for  CSEGs. 
Since  both  contain  a  large  number  of  variables  and  constraints,  the  linear  programming 
problems  are  initially  solved  with  many  of  the  constraints  removed.  If  the  solution  to 
this  relaxed  problem  is  not  a  feasible  optimal  solution,  additional  constraints  arc  added 
and  the  problem  is  solved  again.  This  process  continues  until  a  feasible  optimal  solution 
is  found.  The  results  from  a  numerical  experimentation  with  various  solution  techniques 
are  also  presented. 
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I.  INTRODUCTION 


Cumulative  search-evasion  games  (CSEGs)  involve  two  players,  a  searcher  and  an 
evader,  who  move  among  some  finite  set  of  cells,  C.  Neither  player  is  aware  of  the  other 
player's  position  during  any  stage  of  the  game.  Let  X;  and  Y,  represent  the  positions 
of  the  searcher  and  evader,  respectively,  at  time  t.  If  the  cells  are  numbered  from  1  to 
n.  then  X,  =  i  and  Y,  =]  for  some  i,j  e  {l,2,...,n}  for  all  t.  The  payoff  of  the  game.  N.  is 
given  by 


T 

S=Y.A{X,J,j)  (1) 

.'=1 

where  T  is  the  number  of  time  periods  and  A(X,.  Y,.  t)  is  the  payoff  function.  The 
searcher  wants  to  choose  his  strategy  so  as  to  maximize  the  expected  payoff,  L[N];  the 
evader  desires  to  minimize  the  expected  payoff  While  there  are  many  other  suitable 
payoff  functions,  the  one  of  interest  is  an  indicator  of  the  event  X,  =  Y,.  In  this  case, 
the  payoff  is  equal  to  the  average  number  of  times  that  the  two  players  occupy  the  same 
cell  simultaneously. 

fhis  study  assumes  that  the  starting  positions  for  both  the  searcher  and  the  evader 
are  specified.  In  particular,  let  S„  and  denote  the  starting  locations  (cells)  of  the 
searcher  and  evader,  respectively.  From  one  period  to  the  next,  both  players  arc  allowed 
to  only  mo\c  to  cells  which  arc  adjacent  to  their  currently  occupied  cells.  In  time  period 
t.  let  the  sets  S(X,.t)  and  LC^'j.t)  denote  the  cells  which  are  adjacent  to  X,  and  then 
Xj*,  and  Y|.,  must  belong  to  S(X,.t)  and  L(^',,t),  respectively.  Figure  1  displays  a  one 
dimensional  CSEG  with  four  cells.  lfX,=  3,  then  X,.,  must  belong  to  S(X,.t)=(2,  3, 
4).  In  essence,  the  players  arc  not  allowed  to  "leapfrog"  to  non-neighboring  cells  in  one 
time  period.  Eagle  and  Washburn  gise  several  applications  for  CSFGs  [Ref  1], 

Note  that  the  objective  function  in  a  CSEG  is  not  the  probability  of  detection.  In 
most  search  theory,  the  measure  of  effectiveness  (MOE)  to  be  maximized  is  the  expected 
probability  of  detection.  This  MOE  is  most  often  given  as  E[1  —  e'^],  where  N  is  as 
defined  as  above  and  A(X,. t)  is  interpreted  as  the  detection  rate  at  time  t.  {See 
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Figure  1.  One  Dimensional  CSEG  --  Motion  Feasibility 

Koopman[Ref  2  ].)  Since  E[1  —  e #  1  —  the  CSEG  solution  cannot  be  in¬ 
terpreted  as  a  detection  probability  except  when  N  is  very  small  (Eagle  and  Washburn 
[Ref.  1]). 

Most  search  theory  deals  with  the  optimal  allocation  of  a  searcher's  effort  to  detect 
a  target  which  is  not  allowed  to  actively  evade.  Most  approaches  (see  Stone  [Ref  3]) 
rely  on  Bayesian  methods  for  fmding  optimal  search  plans.  Stone  [Ref  4]  also  surveys 
an  extensive  literature  for  finding  optimal  search  allocation  where  the  searcher  is  un¬ 
constrained  and  target  motion  follows  a  Markov  process.  Eagle  [Ref  5]  and  Stewart 
[Ref  6  ]  have  studied  the  problem  where  the  searcher  is  constrained. 
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Gal  [Ref.  7]  and  Ruckle  [Ref  8]  have  considered  games  in  which  the  target  has 
been  allowed  to  actively  evade,  using  "time  until  capture"  or  "time  until  frst  detection" 
as  the  payoff  Stewart  [Ref  9]  studied  optimal  search  and  evasion  strategies  for  a  two 
cell  model  under  various  constraints.  Stewart's  study  assumes  a  detection  rate  payoff 
function  which  makes  the  analytical  solution  dilTicult  for  even  the  small  model  consid¬ 
ered.  CSEGs  are  thus  an  improvement  on  models  such  as  Stewart's  in  the  sense  that 
games  with  several  cells  can  be  considered.  The  price  paid  for  this  is  that  CSEGs  require 
a  specific,  analytically  convenient  form  for  the  objective  function. 
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II.  EAGLE-WASHBLIRN  FORMULATION 


Eagle  and  Washburn  [Ref.  1]  ofTered  two  methods  for  solving  CSEGs.  One  method 
is  the  Brown-Robinson  method  of  fictitious  play  [Ref.  10].  The  other  approach  is  for¬ 
mulating  the  CSEG  as  a  linear  programming  (EP)  problem.  Similar  to  the  normal 
method  of  EP  solution,  there  are  two  linear  programming  formulations:  one  for  the 
searcher  and  the  other  for  the  evader.  Both  arc  equivalent  in  that  they  are  duals  of  each 
other.  However,  unlike  the  normal  method,  where  each  pure  strategy  has  a  decision 
variable  and  a  payofl'  matrix  must  be  computed,  this  formulation  is  expressed  in  terms 
of  marginal  probabilities  of  the  searcher  occupying  the  cells  in  each  time  period  t.  The 
main  motivation  of  this  formulation  is  to  avoid  generating  all  possible  pure  strategics  for 
both  the  searcher  and  evader.  The  number  of  pure  strategics  grows  exponentially  as  a 
function  of  the  length  of  the  game,  T,  and  the  number  of  cells  in  S(.\,.  tj  and  E(  V,.t). 
Tor  example,  for  a  one  dimensional  search  problem  with  20  time  periods  and  S{X..t)  and 
E(Y,.t)  each  containing  three  cells  for  each  time  period,  there  are  V”  pure  strategics  for 
each  plac  er. 

lo  Ibrmulatc  the  linear  programming  formulation  for  the  searcher.  Eagle  and 
\\'ashburn  define  the  following: 

p(i,t)  =  the  marginal  probability  that  the  searcher  occupies  cell  i  at  time  t 

u(i.j.t)  =  the  probabilitv  that  the  searcher  will  visit  cell  i  at  time  t  and  cell  j  at  time 
t+  1 

7(].\)  =  the  smallest  possible  payoff  accumulated  from  period  t  to  period  T  given  that 
the  evader  occupies  cell  j  in  time  period  t 

S-(  i.t)  =  the  set  of  cells  in  time  period  t-1  from  which  the  searcher  can  reach  cell  i  in 
time  period  t.  lhat  is, 

S"(/./)  =  {A-  e  C|/e  S(A.t-  1)} 

I'or  ieC  and  t=  2.3 . T.  where  S(k,t-1)  is  as  previously  defined.  For  example,  in  Figure 

I.  X-U.t+  1)  =  {1.2}. 
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Then,  the  linear  programming  problem  can  be  stated  as  fellows: 


maxc(£u,l) 


subject  to 


/’(5„.1)=  1 


(2) 


-  V  U{JJ,!-1)+  ^  W(/,A-./)  =  0;  /6  C,  /  =  2,3,....7'- 1  (3) 

7€  5  (/,/)  keS\i.i) 


-/’(5,,.1)+  V  w(5(j.A,lJ  =  0  (4) 

k^SiS^A ) 


—  ^  u[ij.T  —  1 )  +  pii/n  =  0;  /  6  c 
je  s' a. 7) 


—  ^.  h/, /./)/’(/./)  —  :(k,f  +  1)  +  r(/./)  <  0;  j  e  C,  k  e  t  =  1 .2 . T  -  1  (6) 

isC 


-  'y'  A(i,k.r'ip(k.T}  +  zii.T)  =  0;  i  e  C  (7| 

/Ut' 

u\i.i.!)  >  0;  ij  c  C  r  =  0.1 . £  —  1  (S) 

1  he  objective  function  above  corresponds  to  maximi/ung  the  mininuim  payoff  for 
the  searciier  given  that  the  evader  starts  in  cell  Ej.  Constraint  (2)  then  restricts  the 
searcher  to  start  in  cell  S,,  .  To  validate  constraint  (3).  Eagle  and  Washburn  observed 
that  for  ieC  and  t=  1,2 . T-1, 


j^Su.n 


or.  alternativclv 


p{ij)  =  u(jj.t—  1).  (lOl 

s' a, I) 

Tlien.  constraint  (3)  essentially  enforces  the  equality  of  two  equivalent  expressions,  (9) 
and  (10),  for  p(i.t).  There  is  also  a  network  interpretation  for  constraint  (3).  Figure  2 
depicts  the  net\\  ork  interpretation  for  a  one  dimensional  CSEG  with  three  cells  and  three 
time  periods.  The  node  (i,t)  in  the  network  represents  cell  i  in  the  time  period  t  and  the 
How  on  an  arc  connecting  node  (i.t)  to  (j,t+  1)  is  represented  by  u{i,j.t).  Then,  constraint 
(3)  is  simply  the  conservation  of  flows  at  each  node  (i.t).  Constraints  (4)  and  (.'>)  repre¬ 
sent  the  terminal  conditions  I'or  p(i,t)  for  t=  1  and  t=  T,  respccti\'el> . 

Based  on  the  definition,  zij.t)  can  be  written  as 


--{J.D 


isC 


+  min 


zik.I 


(11) 


where  z(..T  +  1  )  =  0.  Constraint  (6)  is  simply  the  linear  representation  of  equati  rn  (11). 
Similar  to  constraints  (4)  and  (5).  constraint  (7)  is  the  terminal  condition  of  equation 
(11). 

The  linear  programming  formulation  for  the  evader  is  the  dual  of  the  above  and  is 
not  presented  here.  'I  he  reader  is  rei'erred  to  Eagle  and  Washburn  [Ref  I]  for  the  de¬ 
tails.  However,  it  should  be  pointed  out  that  the  above  formulation  still  contains  a  large 
number  of  decision  variables,  which  in  turn  contributes  to  the  extensive  CPC  time  re¬ 
quired  to  solve  even  a  moderately  sized  CSFG.  Most  of  these  variables  are  uli.j.t)  vari¬ 
ables.  One  objective  of  this  thesis  is  to  model  the  searcher’s  problem  without  these  flow 
variables. 

For  the  one  dimensional  CSFG,  the  formulation  contains  (3n-2)  f  flow  variables  and 
n'f  smallest  payofi'(z(i.t))  variables.  (.Vlarginai  probability  (p(i,t))  variables  can  be  cal¬ 
culated  from  u(i.i.t)  variables;  they  are  not  needed  to  solve  the  LP.)  The  number  of 
constraints  needed  is  approximately  (4n-2)r+2n. 

The  game  reaches  equilibrium  when  both  searcher  and  evader  marginal  probabilities 

are  uniform  over  cells  1,2 . n.  It  can  be  shown  that  once  tliC  p(*.t)  and  q(*.t)  reach  this 

distribution,  these  distributions  are  optimtd  from  th.it  time  onward  (Faglc  and 
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Figure  2.  Net^\ork  Flon  Interpretation  of  a  One  Dimensional  CSEG 

Washburn  [Ref.  1]).  In  order  for  the  game  to  reach  equilibrium,  it  was  found  by  ex¬ 
periment  that  T  s:  1.5n.  Thus,  the  Eagle- Washburn  formulation  requires  on  tlic  order 
ofbn'  variables  and  constraints. 

In  the  next  chapter,  two  alternate  linear  programming  formulations  are  considered. 
Both  fornuilations  contain  fewer  decision  variables  and  many  more  constraints  than  the 
Eagle  and  Washburn  formulation.  However,  the  main  advantage  is  the  fact  that  many 


of  the  constraints  are  nonbindinc.  Thus,  the  problem  size  can  be  controlled  by  initially 
solving  the  linear  program  with  only  a  small  subset  of  the  constraints  and  iteratively 
adding  new  constraints  and  resolving  as  necessary  until  an  optimal  solution  is  achieved. 


III.  METHODOLOGY 


I  he  Laglc  and  Washburn  formulation  always  produces  an  exact  solution  for 
'  'SLGs.  However,  as  the  size  of  the  problem  grows,  the  time  to  solve  the  LP  grows  even 
more  rapidly,  making  it  impractical  for  solving  large  CSHGs.  This  chapter  considers  two 
alternate  LP  formulations  based  on  preliminary  work  by  Washburn  and  demonstrates 
how  to  solve  these  formulations  in  an  iterative  manner. 

1  0  simplify  the  presentation,  only  one  dimensional  CSHGs  are  considered.  Also,  it 
is  assumed  that 

1.  The  search  area  consists  of  n  cells. 

2.  The  game  is  played  for  T  time  periods. 

3.  The  searcher  occupies  cell  1  at  time  I. 

4.  The  evader  occupies  cell  n  at  time  I. 

5.  The  searcher  and  esader  are  each  allowed  to  move  one  cell  left  or  right  or  remain 
stationary  at  each  time  stop  of  the  game,  i.e.. 

z  (1.2}  i=\ 

SH.t)  =  E(ij)  =  <  {/ -  I.'./  +1}  /=  2.3.. ...rt  -  1 

L  {n  —  I,/;]  /  =  It 


/.  METHOD  ONE 

Let  q(j.t)  be  the  marginal  probability  that  the  evader  will  be  in  cell  j  at  time  t.  Then, 
the  expected  payolf,  v.  is  given  by 
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V  =  =  V  ^.•l(v./)p(/./)^b’.0  (12) 

(=1  iJeC 

where  p(i.t)  and  N  are  as  previously  defined.  A(i.j,t)=  1  in'i  =  j  and  E[N]  denotes  the 
expected  value  of  N.  The  searcher  wishes  to  maximize  the  expected  payofl'  and  the 
evader  wishes  to  minimize  the  expected  payolf. 

Given  that  the  marginal  probabilities.  p(i,t).  are  specified  by  the  searcher,  the  evader 
then  wants  to  find  a  strategy  to  nunimizc  the  payoff  of  the  game.  Let 
\  =  {'l  l.  ;  be  a  feasible  evader  path  or  "track".  If  v  represents  the  value  of  the 
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game,  tlicn  ilie  following  must  hold  for  all  strategies  V  and  marginal  probability  dis¬ 
tributions  p(i.t ), 


f=l  ieC  f=l 

where  the  equality  follows  from  the  fact  that  A(i,Y,,t)=  1  ifTi  = 
first  alternate  formulation  can  be  written  as 

max  V 


V.. 


(13) 

Based  on  ( 1 3 ),  the 


subject  to 


tl4) 


r 

r  <  }',./)  V  }'  (15l 

yy(/./)<  VpO'.^-l);  A- =1.2 . «.  l  =  k,k+\ . n,  /  =  2.3 . T  (16) 

;=/:  j=f-\ 

pi,!.!]  >  0;  /=  1,2 . n.  l-  1.2 . T  (P) 


Constraint  (14|  ensures  that  the  marginal  probability  must  sum  to  one  for  each  time 
period  and  constraint  (15)  enforces  the  optimality  condition  expressed  by  equation  (13). 
hinally,  constrtiints  (14)  and  (16)  guarantee  that  there  exists  a  corresponding  set  of  fea¬ 
sible  u(i.j.t).  To  illustrate  that  this  is  true,  consider  the  CShG  with  six  cells  and  let  k.=  2 
and  1  =  4.  Then,  constraint  (16)  translates  to 

p[2.i)  -t-  /’(3,/)  -I-  p{A.i)  <  /’(l.t—  1)  +  pi2j  —  1)  -)-  /’(3./ —  1)  -I-  p[A.!  —  1)  -I-  p{>.i  —  1) 

which  simply  implies  that  the  probability  that  the  searcher  will  occupy  cells  2.  3  or  4  at 
time  t  must  not  be  larger  than  the  probability  that  he  will  occupy  cells  1,  2.  3.  4  or  5  at 
time  t-1.  If  this  condition  docs  not  hold,  there  can  not  exist  a  corresponding  feasible 
"transition"  probability,  u(i.j.t).  In  the  network  interpretation,  constraint  (14)  ensures 
that  the  total  "supph  "  leaving  nodes  (i.t-1)  and  the  total  "demand"  arris ing  at  nodes  (i.t) 


!() 


for  i=  1,2,. ..,n  is  equal  to  one.  Constraint  (16)  ensures  that  the  amount  of  probability 
"shipped"  along  the  arcs  cannot  exceed  the  "supply"  of  probability  available. 

Even  for  a  moderately  si/cd  CSEG.  the  above  formulation  contains  an  extremely 
large  number  of  constraints,  in  particular  those  which  are  described  in  constraints  (15) 
and  (16).  Thus,  it  would  be  prohibitive  to  generate  all  the  constraints  and  solve  the  re¬ 
sulting  EP.  Instead,  the  algorithm  below  initially  solves  the  problem  with  one  strategy 

^’=  {n.n . n).  i.e.,  the  evader  remains  in  cell  n  for  all  T  time  periods,  and  disregards  all 

type  (16)  constraints.  Afterward,  the  violated  constraints  are  added  iteratively  until  all 
binding  constraints  are  included  in  the  formulation.  The  algorithm  can  be  stated  as 
follows; 


Method  One  Algorithm 

Step  0:  Set  k  =  0  and  let  (C. />''(/./))  solve  the  following 
EP((t): 


m;ix  V 


subject  to 

yj'ii,n=  1;  /=  1.2 . T 


(ISj 


r 

r  <  pin  /) 
r=l 

f>{ij)>0:  i=  1.2 . 1=  1,2,. ..7' 


(191 


(2iii 


Step  1:  If  (v'.  p'(/,n)  is  feasible  by  constraint  sets  (15)  and  (l(').  then  (r.p’iij)]  is  a 
solution.  Otherwise,  go  to  Step  2. 

Step  2:  Generate  constraints  from  the  constraint  sets  (15)  and  (16)  which  vio¬ 
lates  and  add  them  to  problem  EP(k)  to  obtain  a  new  problem  EP(k+  1 ). 

Step  3:  Eet  (r'h />'■'(/, pi)  solve  EP(k+  1).  set  k=k+  1  and  go  to  Step  I. 


In  Step  2.  the  feasibility  of  constraint  set  (16)  is  tested  from  level  I  to  level  n-2  for  every 
time  period  until  an  infeasible  condition  is  found  or  the  solution  can  be  declared  feasible. 
The  level  refers  to  the  number  ol' cells  considered.  Tor  example,  the  level  1  feasibility  test 
consists  ol'  ensuring  that  p(i.t)  <  p(i-l.t-l)  +  p(i.t-l)  p(i+l,t-l)  for  ieC  and 

t=  2.3 . f.  where  p(<>,*)  and  p(n+  1.*)  are  defined  to  be  zero.  11' this  test  is  violated,  a 

constraint  of  type  (16)  is  added  to  the  linear  program  for  every  such  violation  of  level  1 
feasibility  tests  and  the  LP  is  solved.  11  no  violation  is  found,  level  2  feasibility  tests  are 
performed.  These  tests  ensure  that  p(i.t )  +  pti-i- I.t)  <  p(i-I.t-l )  +  p(i.t-l)  +  p(i-!-l.t-l) 
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+  p(i  +  2,t-l)  for  i=  1.2 . n-1  and  t  =  2.3 . T,  where  p(0.*)  and  p(n  +  1,»)  are  defined  to 

be  zero.  These  tests  continue  until  a  feasibility  violation  is  found  and  the  necessary 
constraints  added  or  until  the  solution  is  found  feasible.  The  number  of  these  con¬ 
straints  could  potentially  grow  as  large  as  ^n(n+  1  )'f .  but  only  a  fraction  of  these  con¬ 
straints  are  needed. 

Then,  to  test  for  feasibility  for  constraint  (15),  find  a  track,  ,  for  the  evader  such 
that  the  sum  of  all  p(^',,t)  over  all  t  is  a  minimum  among  all  tracks.  This  can  be  ac¬ 
complished  by  solving  an  appropriate  shortest  path  problem.  If 

T 

<  >•''  1^1) 

/=i 

then  constraint  type  (15)  is  violated  and  the  constraint 

r 

V  <  JyH  >',./)  (22) 

/=i 


must  he  added. 

Method  One  was  altered  in  two  ways  to  attempt  to  reduce  computation  time.  One 
variation  involved  elimiitating  slack  constraints.  Since  each  successive  LP  is  larger  than 
the  previous  LP.  the  time  to  solve  each  LP  grows.  By  eliminating  constraints  that  re¬ 
main  slack  I'or  several  successive  LP  solutions,  the  overall  size  of  the  LP  is  reduced. 

'fhe  other  variation  invohed  starting  with  a  set  of  path  constraints,  or  tvpc  (15) 
constraints,  in  addition  to  the  usual  starting  constraints.  If  these  path  constraints  can 
be  chosen  so  as  to  cover  the  critical  paths  (path  constraints  that  are  tight  in  the  final 
solution),  this  may  reduce  the  number  of  algorithm  iterations  necessary  to  arrive  at  the 
problem  solution. 

B.  METHOD  TWO 

The  second  method  is  similar  to  the  first  method,  except  that  constraint  set  (15)  is 
replaced  by  the  recursive  definition  of  the  z(»,»)  variables  stated  in  Chapter  11.  Using  the 
fact  that  A(i.j.t)  =  1  ilT  i  =  j,  z(».*)  can  be  redefined  as  follows: 

r(/.t )  =  /’(/./) -I- min  r(A./-)-l)  (2,3) 

/’€/  i;,;) 
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where  z(-.r+  l)  =  U.  Both  types  of  constraints  serve  the  same  purpose:  to  ensure  that 
the  g;  me  value  is  equal  to  the  mmimum  payofT' possible  for  a  given  p{».*)-  However, 
cor.straint  set  (15)  was  added  as  needed,  while  constraints  corresponding  to  equation 
(23)  are  all  in  the  initial  LP.  The  advantage  of  the  method  is  the  fact  that  equation  (23) 
produces  (3n-2)l  constraints  while  constraint  set  (15)  contains  3^. 

Method  Tmo  Algorithm 

Step  0:  Let  k  =  0  and  solve  the  following 

LP((i): 

max  r 

subject  to 

V;, (/,/)=  1;  ,=  1.  2 . T  (24) 

I  (25) 

:u.ij  <  zijj  +  1=  1,2 . n,  J  e  /=  1,2 . T-  1  (26) 

/’(/./)  >  (I;  /=  1.2 . n,  1=  1.2 . T  (27) 

Step  1;  If  (',■•./’•(/./))  is  feasible  to  constraint  set  (16).  {v\p'(i,i))  is  a  solution.  Other¬ 
wise.  go  to  Step  2. 

Step  2:  Lind  cons-.raints  of  type  (16)  which  are  violated  and  add  tliem  to  problem 

LP(,k)  to  obtain  a  new  problem  LP(k+  1). 

Step  3:  Let  (i'"'./’'‘'|/./l)  sohe  LPik-s-  1).  set  k=k+  1  and  go  to  Step  1. 

Note  that  the  method  (or  finding  violated  constraints  in  Step  2  is  as  described  lor 
Method  One, 

Method  fwo  was  altered  in  two  ways  in  an  attempt  to  reduce  computation  time. 
The  first  variation  was  the  method  of  eliminating  slack  constraints  as  done  with  Method 
One.  'I  he  second  variation  made  was  adding  a  group  of  motion  feasibility  constraints, 
i.e..  constraint  set  (16)  to  LP(0).  This  variation  is  similar  to  the  second  variation  on 
Method  One.  If  this  group  of  motion  feasibility  constraints  is  chosen  so  as  to  cover 
those  motion  feasibility  constraints  which  arc  tight  in  the  solution,  the  number  of  algo¬ 
rithm  iterations  may  be  reduced.  1  he  method  devised  for  choosing  motion  feasibility 
constraints  for  the  starting  group  was  drawn  from  examination  of  CSLG  solutions  ob¬ 
tained  through  the  use  ol  Method  Two.  Ihis  method  proved  very  successful  and  is  de- 
Hribed  below  as  Method  Three. 
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C.  METHOD  THREE 


Method  Three  is  essentially  the  second  variant  of  Method  Two.  except  that  the 
performance  of  Method  Three  is  markedly  better  because  it  does  not  require  successive 
iterations  to  arrive  at  an  optimal  solution.  An  examination  of  the  tight  motion  fea'^i- 
bility  constraints  in  optimal  solutions  using  .Method  Two  reveals  that  all  these  motion 
feasibility  con'^traints  arc  of  the  form; 

/  /+) 

-  H;  /=  2  (28) 

y=l 

All  these  constraints  include  cell  1,  the  left-most  cell.  'I'hesc  constraints  will  be  referred 
to  as  left-anchored  constraints. 

Another  obsert  ation  from  previous  solutions  is  that  the  searcher  always  rushes  from 
cell  1  to  cell  t^-1  during  the  first  t^-l  thne  periods  where  t  =  f^  is  the  first  time  period  in 
which  the  searcher  and  evader  can  cui.  >ide.  When  there  are  n  cells,  $=  "T  j  w  hen  n 
is  odd  and  =  1  when  n  is  even.  Here  [x]  denotes  the  smallest  integer  m  such  that 

.\<m.  Since  the  searcher  and  evader  cannot  occupy  the  same  cell  during  these  first  (1-1 
time  periods,  'i\  .t)  =  0  for  t=  1,2 . 0-i  for  any  pair  of  searcher  and  esader  strate¬ 

gics  (\.\‘).  Thus,  no  payofl' occurs  during  periods  1  to  0-1  and  2(n.l)  must  be  the  min¬ 
imum  of  zii.O)  where  i=0.0-i-l . n.  This  observation  allows  lor  ignoring  all  those 

decision  variables  from  the  first  0-1  time  periods.  This  reduces  the  number  of  variables 
and  constraints  by  approximately  one-third. 

Use  of  this  formulation  with  lelt-anchored  motion  feasibility  constraints  will  solve 
(,'SLGs  as  large  as  n=  12.  In  larger  CSEGs.  there  exists  another  set  of  tight  motion 
feasibility  constraints  which  arc  anchored  on  the  right-most  cell,  cell  n.  For  th?sc 
CSFGs,  inclusion  of  this  set  of  constraints  for  the  last  few  time  periods  leads  to  an  op¬ 
timal  solution.  If  we  let  t  =  the  first  time  period  in  which  the  right-anchored  motion 
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feasibility  constraints  are  required,  then  the  LP  is  as  follows: 


max  V 


subject  to 


V' pii.i)  =  1'  r  =  . T  (29) 

i=i 

r(/./)  <  2(/./ +  I  j  + /’(/./);  i  =  . T.  i  =  \.2....,n,  j  e  E{i,t)  (30) 

V  <  rf;.  i  =  n  +  1  —  B.n  +  2  —  B . n  (31 ) 

/  .'4  1 

-  1);  /  =  t)-t-l,()+2 . 7',  /=1.2 . n-2  (32) 


•  jV.i)  <  /’(/./- 1 );  /  =  T,  T+1 . 7.  /  =  «.«- 1,... .3 

i=/  M- 1 


(33) 


p[i.i]  >  0;  i=  1,2 . /i,  /=  1,2 . T  (34) 

where  z(*,'f+  1)  =  0.  Constraint  (29)  ensures  the  niar;:inal  probability  summed  over  all 
cells  in  a  time  period  is  equal  to  one.  Constraints  (30)  and  (31 )  perform  the  same  func¬ 
tion  a';  equation  (23).  Constraint  (32)  delineates  all  levels  of  Iclt-anchorcd  motion  fea¬ 
sibility  con‘araints  for  time  periods  of  interest.  Constraint  (33)  describes  all 

right-anchored  motion  feasibilitv  constraints  for  time  periods  of  interest,  'fhc  number 

2  - .  '  S 

of  variables  is  -^n'f+  1  and  the  number  of  constraints  is  on  the  order  of  -irfiT.  .Assum- 
,1  3 

ing  T  5;  — n.  there  are  approximately  n-  variables  and  4n-  constraints.  This  formulation 
provides  solutions  for  CSTGs  up  to  at  least  size  n=  30. 
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IV.  RESULTS 


Methods  One  and  l  u  o  were  both  implemented  through  the  use  of  a  I'OR’l  RAN 
interhicc  with  LINDO  (Linear  Interactive  Discrete  Optimizer).  Method  Three  and  the 
Lagle-Washburn  model  were  implemented  in  G.VMS  (General  and  Algebraic  Model 
Solver)  using  MINOS  (Modular  In-Core  Nonlinear  Solver).  All  methods  were  executed 
on  an  IBM  3033AP  mainframe  computer  at  the  Naval  Postgraduate  School,  Monterey, 
California. 

A.  METHOD  COMPARISON 

Method  One  and  its  variants  performed  considerably  worse  than  the  Eagle- 
A'ashburn  model  for  n  >  8.  Tigure  3  shows  computation  time  in  CPC  seconds  versus 
('SLG  si/e  for  both  methods.  Method  Two  is  slightly  faster  than  Method  One.  but  does 
not  perform  as  well  as  the  Lagle-A'ashbuin  model  for  n  >  10.  In  f  igure  4,  2-1  indicates 
the  performance  of  .Method  'fwo  and  2-2  indicates  the  performance  of  the  .Method  Two 
variant  with  slack  constraint  elimination. 

Using  Methods  One  and  Two  for  solving  larger  CSLGs  results  in  excessive  compu¬ 
tation  time  due  to  the  increased  number  of  LPs  that  must  he  solved.  The  strategy  of 
solving  several  smaller  LPs  instead  of  one  large  LP  fails  because  of  the  large  number  of 
small  LPs  that  must  be  solved  to  arrive  at  the  problem  solution. 
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Compulotion  Time 


Figure  3.  Computation  Time  of  Method  One  vs.  EagIe-\\  ashburn  Method 
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Computotion  Tim« 


Figure  4.  Computation  Time  of  Method  Tno  vs.  EagIe-\\  ashburn  Method 

Mcliiod  I  hrcc  proved  to  dominate  the  tagIc-Washhurn  model  in  all  cases  tested 
(n  <  3(»).  Figure  5  shows  computation  times  for  various  si7e  (.'SI:G  solutions  under 
both  models.  Method  Three  allowed  for  solution  of  larger  (.'SFCis  than  was  pies  iou'-ly 


IS 


CPU  Seconds 


econorrucal  using  the  Hagle-W'ashburn  model.  Solutions  of  these  larger  CSHGs  have 
similar  structure  to  smaller  CSI.C}  solutions,  while  showing  some  small  din'erences. 


Compulation  Time 


Figure  5.  Computation  Time  of  Method  Three  vs.  Eagle-W  ashburn  Method 
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B.  CSEG  SOLUTION  STRUCTURE 

Our  concentration  has  been  on  finding  the  optimal  searcher  and  evader  marginal 
probabilities  IVom  the  start  of  the  game  until  the  marginal  probabilities  reach  equilib¬ 
rium.  '1  he  strategies  of  both  players  have  been  described  previously  b_\  Eagle  and 
W  ashburn  [Rel'.  1]  for  one-dimensional  CSEGs  as  large  as  n=  12.  Strategies  in  the 
larger  games  do  not  difi'er  greatly  from  those  in  smaller  games. 

One  pure  strategy  that  nught  be  advantageous  to  the  evader  includes  staying  in  cell 
n  until  the  searclicr  can  reach  that  cell.  If  the  game  were  played  for  less  than  n  time 
periods,  this  would  be  the  optimal  strategy  for  the  evader,  since  it  would  ensure  a  zero 
payoff.  However,  for  longer  games,  this  strategy  is  not  optimal  because  of  the  large 
pacoiTthe  searcher  can  force  when  l  >  n.  This  strategy  of  waiting  is  part  of  a  larger 
group  of  strategies  that  can  be  called  "wait-and-run"  strategies,  'fhe  evader  stays  in  cell 

n.  or  waits,  for  k  time  periods,  where  k  =  (t.l.2 .  After  he  has  waited  k  time  periods. 

he  moves  to  the  left  at  top  speed,  one  cell  per  time  period,  until  reaching  the  left-most 

ce'is. 

Eigurcs  6  and  7  show  that  the  ....  aer  mi.xed  strategy  consists  ol  several  "wait-and- 
run"  pure  strategies.  If  we  interpret  the  probabilities  as  being  parts  of' a  large  force,  such 
as  soldiers  in  an  army,  we  can  explain  the  results  as  follows.  Note,  in  Eigure  7.  how  .’6 
units  break  olT immediately  frotn  the  main  force  of  loot)  units  in  the  second  time  period. 
These  36  units  continue  to  move  left  at  the  rate  of  one  cell  per  time  period  until  reaching 
cell  I  at  time  2n.  fhis  strategy  corresponds  to  waiting  zero  time  periods  belbre  running. 
Other  "wait-and-run"  stiategies  arc  used,  fn  each  successive  period,  the  size  of  the  force 
whicii  breaks  off  from  the  main  force  in  cell  n  increases.  A  large  portion  of  the  esader's 
force  remains  in  ceil  n  through  the  time  period  in  which  tiie  searcher  first  arrixes  in  cell 
n-1.  At  this  point,  the  es  ader  disperses  this  force  from  cell  n  as  quickly  as  is  feasible  over 
the  next  few  time  periods.  See  f  igure  S  for  details  of  this  stratege  on  an  expanded  scale. 
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Figure  7.  Evader  Marginal  Probabilities  (xlOOU)  for  20-CeI!  CSEG. 


and  then  flattens  out.  Since  both  players  can  have  forces  in  all  cells  at  this  point,  the 
evader  esscntiall}  disperses  his  forces  to  reach  a  uniform  distribution  over  all  cells. 

Instead  of  using  the  individual  soldiers  interpretation,  the  explanation  can  also  be 
made  in  terms  of  the  probability  of  choosing  a  pure  strategy  from  the  optimal  mixed 
strategy.  The  evader  chooses  from  a  number  of  "wait-and-run"  strategies.  It  is  more 
likely  that  he  will  wait  for  long  periods  of  time  before  running  than  running  early  in  the 
game.  After  reaching  the  left-most  cells,  it  appears  the  evader's  motion  becomes  more 
random  as  he  spreads  out  towards  a  uniform  distribution. 

The  searcher  begins  the  game  by  rushing,  or  moving  right  at  top  speed,  one  cell  per 
time  period.  His  optimal  strategy  always  consists  of  rushing  over  the  first  d-\  periods 
where  6  =  the  first  time  period  in  which  the  searcher  and  evader  may  occupy  the  same 
cell.  Consider  the  five  ceil  CSEG  where  the  searcher  begins  in  cell  I  and  the  evader  be¬ 
gins  in  cell  Two  time  periods  later.  t=  3.  the  searcher  could  travel  as  far  right  as  cell 

3.  while  the  evader  could  travel  as  far  left  as  cell  3.  Thus,  for  the  live  cell  CSHG.  6=  3. 

This  lirst  possible  meeting  point  is  cell  when  n  is  odd  and  cell  1  when  n  is 

even.  The  searcher  gains  nothing  by  stalling  during  these  first  time  periods:  for  eveiy 
time  period  he  waits,  he  extends  the  number  of  zero  payolfs  he  will  receive. 

During  some  time  period  {B  for  CSEGs  where  n  is  even,  6+  1  for  CSEGs  where  n 
is  odd),  the  e\ader  could  for  the  first  time  be  in  a  cell  to  the  left  of  the  searcher.  Tor 
example,  consider  the  six  cell  CSTG.  .At  time  4,  the  searcher  could  be  as  far  right  as  cell 

4.  the  evader  as  lar  left  as  cell  3.  If  the  players  occupy  those  cells  when  t  =  4,  then  during 
time  3.  the  searcher  and  evader  were  in  cells  3  and  4.  respectively.  1  hus,  at  time  4.  the 
searcher  must  split  his  forces  between  cells  3  and  4  to  en.sure  that  the  evader  cannot  pass 
by  without  coincidence.  This  split  ol  searcher  forces  arises  in  all  CSTGs. 

1  0  return  to  using  the  analogy  of  individual  soldier  movement,  after  this  initial  split 
is  made,  the  majority  of  the  searcher's  forces  continue  rushing  towards  cell  n,  while  small 
forces  split  from  this  majority  at  every  time  step.  See  Figures  9  and  10.  I  hese  small 
forces  travel  back  towards  cell  1,  much  as  the  evader's  '  wait-and-run''  I'orces  do.  These 
small  fractions  of  the  searcher's  forces  make  sure  that  the  "wait-and-run "  forces  of  the 
evader  do  not  break  through  without  paying  some  penalty.  ,As  with  the  csadcr's  'wait- 
and-run"  forces,  the  searcher's  small  split-off  groups  increase  in  si/e  as  the  searcher  nears 
cell  n.  Like  the  evader,  once  the  searcher  reaches  cell  n,  he  also  disperses  this  main  force 
as  quickly  as  feasible.  The  forces  then  tend  to  move  towards  the  uniform  distribution. 
See  Figure  11  for  an  expanded  view  of  the  searcher's  strategy  for  the  final  time  periods. 
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Figure  10.  Searcher  Marginal  Probabilities  (xlOOO)  for  20-Cell  CSEG. 
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.cm.  c.rci,„„s,„,  „ 


Most  often,  he  will  continue  to  rush  towards  cell  n.  Sometimes,  with  a  small  probability, 
he  will  turn  back  and  rush  towards  cell  1.  .4t  each  time  step,  the  searcher  makes  a  de¬ 
cision  on  whether  to  reverse  motion;  each  lime  the  probability  of  reversing  direction  in¬ 
creases.  Once  the  searcher  has  reached  cell  n  (if  he  has  chosen  this  strategy),  his  strategy 
is  similar  to  the  evader  as  both  spread  towards  a  uniform  distribution  over  all  cells. 

■Another  striking  point  of  the  optimal  solutions  is  the  tendency  of  neighboring  p(i.t) 
and  q(i.t)  values  to  be  equal.  These  groups  of  equal  value  come  most  often  in  pairs; 
towards  the  end  of  the  game,  they  come  in  larger  groups.  T  his  is  most  easily  seen  in 
Figures  7  and  in,  the  tabular  displays  of  searcher  and  evader  probability  distributions 
for  the  20-cell  CSEG.  Although  there  are  exceptions,  these  exceptions  probably  result 
from  arriving  at  an  alternate  optimal  solution.  In  working  with  small  CSFGs  that  ex¬ 
hibit  this  exception,  adding  additional  constraints  to  force  equality  among  neighbors 
results  in  an  alternate  optimal  solution. 


V.  CONCLUSIONS  AND  RECOMMENDATIONS 


A.  CONCLUSIONS 

The  lormulation  of  Methods  One  and  Two  was  intended  to  reduce  computation 
time  in  two  ways: 

1.  Reducing  the  number  of  decision  variables  by  using  marginal  probability  variables 
(p(i.t))  instead  of  probability  flow  variables  (u(i.j,t)). 

2.  Reducing  the  work  required  to  solve  the  game  by  reducing  the  number  of  con¬ 
straints. 

The  switch  to  marginal  probability  variables  reduces  the  number  of  variables  needed  to 
define  the  searcher's  strategy  b\  two-thirds  for  the  one-dimcnsional  game.  A  higher 
factor  would  apph  in  the  two-dimensional  game.  However,  the  iteraticc  method  of  se¬ 
lecting  constraint'-  for  successicc  1,P  solutions  proved  to  drastically  increase  the  compu¬ 
tation  time  necessar>  to  solve  larger  games. 

Inspection  of  the  results  obtained  from  various  sizes  ofCShOs  solved  with  .Methods 
One  and  Two  led  to  the  formulation  of  .Method  Three.  With  Method  Three,  computa¬ 
tion  time  was  further  reduced  by: 

1.  Lliminating  decision  variables  for  those  time  periods  the  searcher  and  evader  can¬ 
not  coincide. 

2.  Using  those  feasibiiits'  constraints  of  type  (16)  which  contain  p(  l.t)  for  each  time 
period. 

.1.  Using  tliose  feasibilits  constraints  of  type  ( l(')  which  contain  p(n.t)  for  the  final  few 
time  periods, 

Lliminating  the  first  few  time  periods  in  the  one-dimensional  CSLG  reduces  the  number 
of \ariables  b>  approximatelv  one-third.  I  hc  number  of  constraints  is  also  reduced  by 
one-third. 

.Method  Three  proves  to  be  a  faster  solution  method  than  the  formulation  of  Eagle 
and  Washburn.  The  use  of  just  left-  and  right-anchored  constraints  for  motion  feasibil¬ 
ity  constraints  is  efl'ective  for  n  <  .’P. 

B.  RECO.MMENDATIONS 

The  time  required  to  sohe  CSEGs  on  the  order  of  n=  30  still  remains  very  large  even 
with  the  reduction  achieved  with  Method  Three.  Further  reduction  may  be  possible 
through  the  elimination  of  more  variables  or  constraints. 


In  Methods  1  wo  and  I  hroe,  all  type  (26)  constraints  are  used.  It  may  be  possible 
to  identify  and  eliminate  those  constraints  which  are  always  slack.  Previously  mentioned 
was  the  tendency  of  neighboring  p(i.t)  and  q(i.t)  values  to  be  equal.  The  number  of 
variables  may  be  further  reduced  if  the  game  can  be  modeled  using  pairs  or  groups  of 
cells  as  decision  variables.  Txtension  of  Model  Three  to  the  two-dimensional  game 
should  be  attempted.  The  two  dimensional  CSEG  would  more  closely  model  the  real 
aspects  of  physical  search  than  the  one  dimensional  game.  The  solutions  to  CSEGs  are 
ver>'  structured  and  there  may  be  more  ways  of  exploiting  their  characteristics  to  solve 
larger  games  more  quickly. 
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APPENDIX  GAMS  PROGRAM  OF  METHOD  THREE 


STITLE  One-ditnensional  CSEG  written  by  LT  B.  P.  Bothwell  March  1990 

CONTEXT 

This  model  uses  the  LP  presented  as  Method  Three.  It  has  been 
proven  to  solve  CSEGs  up  to  a  size  of  n=30.  The  dimensions  of  the  set  I 
(cells)  is  equal  to  n.  The  dimension  of  the  set  T  (time)  is  n+1  where 
t=FIRST,  FIRST+1,... ,INT(1.5n)+l  where  FIRST  =  the  first  time  period  in 
which  the  searcher  and  evader  may  first  coincide.  The  model  only 
requires  the  motion  feasibility  constraints  of  level  n-2  and  lower.  For 
example,  if  n=12,  it  is  only  necessary  to  include  FEASl  through  FEASIO 
and  RFEASl  through  RFEASIO.  If  it  is  desired  to  solve  a  CSEG  of  size 
n>30,  additional  FEAS  and  RFEAS  constraints  must  be  added.  The  program 
displays  searcher  and  evader  marginal  probabilities,  game  values,  and 
minimum  and  maximum  possible  payoff  (z,ze)  v'alues. 

$0FFTEXT 

$0FFSYMXREF  OFFSYMLIST  OFFUELLIST  OFFUELXREF 

OPTIONS  LIMROW=0 , LIMCOL=0 , S0LPRINT=0FF ,RESLIM=3000 , ITERLIM=12000 
OPTION  LP=M1N0S5; 

SETS 

I  cells  /C1*C12/ 

T  time  periods  /T7*T19/; 

ALIAS  (I,J); 

PARAMETERS 

FIRST  first  non-trivial  time  period 

ULTRA  first  time  period  for  right-handed  constraints  ; 

$0NTE.XT 

FIRST  must  be  set  to  the  first  time  period  in  which  the  searcher  and 
evader  can  coincide. 

ULTRA  is  the  first  time  period  in  which  right-anchored  constraints 
are  used.  It  is  currently  set  to  write  these  constraints  for  the  last 
four  time  periods.  ' 

SOFFTEXT 


.31 


FIRST=7; 

ULTRA=CARD(T)+FIRST-4; 

POSITIVE  VARIABLES 

P(I,T)  searcher  marginal  distn  in  cell  i  at  time  t 

Z(I,T)  min  value  obtainable  from  t  to  T  given  evader  in  i  at  t; 

$0NTEXT 

P(i,t)  is  fixed  at  zero  if  it  is  infeasible  for  the  searcher 
to  reach  that  cell 
$OFFTEXT 

P.FX(I,T)$(ORD(I)  GT  0RD(T)+FIRST-1)  =  0; 

VARIABLE 

V  game  value; 

SONTEXT 

Equation  description 


GAMEVAL  constraints  ensure  v  <  z(i,t)  for  i  >  FIRST-1  and  t  =  FIRST 
DIST'"  constraints  ensure  p(  1  ,t)+p(2,t)+.  .  . +p(n,t)  =  l  for  t>FIRST 
NET"  constraints  ensure  2(i,t)  c  z(j,t+l)  +  p(i,t)  for  i  in  C, 
j  in  E(i,t)  and  t=FIRST,. , . ,CARD(T)-1 

FEASa  constraints  ensure  p( 1 ,t)+. . . +p( a , t)  <  p( 1 ,t-l)+. . . +p( a+1 ,t-l) 
for  a=l,...,n-2  and  t  >  FIRST+1 

RFEASa  constraints  ensure  p(n,t)+. . . +p(n+l-a,t)  <  p(n , t- 1 )+. . . +p( n-a , t- 1 ) 


for  a=l , .  . .  ,n-2 
$0FFTEXT 
EQUATIONS 

GAMEVAL(I,T) 

DISTONE(T) 

DISTTWO(T) 

NETLd.T) 

NETE(I,T) 

NETM(I,T) 

FEASl(T) 

RFEASl(T) 

FEAS2(T) 


and  t  >  FIRST+1 


game  value  constraints 

inequality  distn  constraints 

equality  distn  constraint-final  time  period 

intermediate  network  constraint  type  1 

intermediate  network  constraint  type  e 

intermediate  network  constraint  type  m 

feasibility  constraints  for  searcher  marginals 


RFEAS2(T) 

FEAS3(T) 

RFEAS3(T) 

FEAS4(T) 

RFEAS4(T) 

FEAS5(T) 

RFEAS5(T) 

FEAS6(T) 

RFEAS6(T) 

FEAS7(T) 

RFEAS7(T) 

FEAS8(T3 

RFEARSri) 

FEAS9(T) 

RFEAS9(T) 

FEASIO(T) 

RFEASIO(T) 

FEASIKTJ 

RFEASll(T) 

FEAS12(T) 

RFEAS12(T) 

FEAS13(T) 

RFEAS13(T) 

FEAS14(T) 

RFEAS14(T) 

FEAS15(T) 

RFEAS15(T) 

FEAS16(T) 

RFEAS16(T) 

FEAS17(T) 

RFEAS17(T) 

FEAS18(T) 

RFEAS18(T); 


SONTEXT 


FEAS19(T) 

RFEAS19(T) 

FEAS20(T) 

RFEAS20(T) 

FEAS21(T) 

RFEAS21(T) 

FEAS22(T) 

RFEAS22(T) 

FEAS23(T) 

RFEAS23(T) 

FEAS24(T) 

RFEAS24(T) 

FEAS23(T) 

RFEAS25(T) 

FEAS26(T) 

RFEAS26(T) 

FEAS27(T) 

RFEAS27(T) 

FEAS28(T) 

RFEAS2S(T)  ; 

$OFFTEXT 

GAMEVAL(I,T)S((ORD(I)  GE  FIRST>1)  AND  (ORD(T)  EQ  1)).. 

V  =L=  Z(I,T)  ; 

DISTONE(T)S(ORD(T)  LTCARD(T)).. 

SUM(I,P(I,T))  =L=  100  ; 

DISTTR'OCTjSCORDCT)  EQ  CARD(T)).. 

SGM(I,P(I,T))  =E=  100  ; 

NETL(I,T)$(ORD(I)  GT  1).  . 

Z(I,T)  =L=  Z(I-1,T+1)  +  P(I,F)  ; 

NETE( I ,T). . 

Z(I,T)  =L=  Z(I,T+1)  +  P(I,T)  ; 

NETM(I,T)$(ORD(I)  LT  GARD(I)).. 

Z(I,T)  =L=  Z(I+1,T+1)  +  P(I,T)  ; 

FEAS1(T)S((0RD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 
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SUM(I$(,ORD(I)  EQ  1),P(I,T))  =L=  SUM( J$(ORD( J)  LE  2),  P(J,T-1))  ; 
FEAS:(T)$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

S''M(I$(ORD(I)  LE  2),P(I,T))  =L=  SUM( J$( ORD( J)  LE  3),  P(J,T-1))  ; 
FEAS3(Tj$( (OKD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUM( I$(ORD( I)  LE  3),P(I,T))  =L=  SUM( J$(ORD( J)  LE  4),  P(J,T-1))  ; 
FEAS4(T)$((0RD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUM(I$(ORD(I)  LE  4),P(I,T))  =L=  SUM( J$(ORD( J)  LE  5),  P(J,T-1))  ; 
FEAS5(T)$( (ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T) ) ) .  . 

SUMCI$(ORD(I)  LE  5),P(I,T))  =L=  SUM( J5(ORD( J)  LE  6),  P(J,T-1))  ; 
FEAS6(T)S((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUM(I$((ORD(I)  LE  6)),PCI,T))  =L=  SUM( J$((ORD( J)  LE  7 ) ) , P( J ,T- 1 ) )  ; 
FEAS7(T)$(,(ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUM(I$((ORD(I)  LE  7)),P(I,T))  =L=  SUM( J$((ORD( J)  LE  8) ) , P( J .T- 1) 1  ; 
FEAS8(T)$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SU:i(  IS(  (ORD(  I)  LE  8)),P(I,T))  =L=  SUM(  J$(  ( ORDC  J )  LE  9 ) ) ,  PC  J  ,T- 1 ) )  ; 
FEAS9(T)$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUM(I$((ORD(I)  LE  9)),P(I,T))  =L=  SUM( J$( ( ORD( J)  LE  10) ) , P( J ,T- 1 ) ) ; 
FEAS10(Tj$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARU(T))).. 

SUM(1$((0RD(I)  LE  10)),P(I,T))  =L=  SUM( J$( ( ORD( J)  LE  1 1 ) ) , P( J ,T- 1 ) ) ; 
FEAS11(T)S((0RDCT)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUMCI$((ORD(I)  LE  11)),P(I,T))  =L=  SUM( J$( ( ORD( J)  LE  12 ) ) , Pc J ,T- 1 ) ) ; 
FEAS12(T)$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUM( I$((ORD( I)  LE  12)),P(I,T))  =L=  SUM( J$( (ORD( J)  LE  13 ) ) , PC J ,T- 1 ) ) ; 
FEAS13(T)$C(ORDCT)  GE  2)  AND  (ORD(T)  LT  CARD(T) ) ) .  . 

SUM(I$((ORD( J)  LE  13)),P(I,T))  =L=  SUM( J$( (ORD( J)  LE  14 ) ) , P( J ,T- 1 ) ) ; 
FEAS14(T)$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUMC I$((ORD( I)  LE  14)),P(I,T))  =L=  SUM( JS( (ORD( J)  LE  15) ) ,P( J,T-1) ); 
FEAS15(T)$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

Sl'M(I$((ORD(I)  LE  15)),P(I,T))  =L=  SUM(J$(  (ORD(J)  LE  16) ) ,  P(  J  ,T- 1 ) ) ; 
FEAS16CT)$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUM(I$((ORD(I)  LE  16)), PCI, T))  =L=  SUM( J$( ( ORD( J)  LE  17 ) ) , P( J ,T- 1 ) ) ; 
FEAS17(T)S((ORD(T)  GE  2)  AND  (ORD(T;  LT  CARD(T))).. 

SUM(I$((ORD(I)  LE  17)),P(I,T)D  =L=  SUM( J$C ( ORD( J)  LE  18) ) ,P( J ,T- 1 ) ) ; 
FEAS18fT)Sf (ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 


SUM(I$((ORD(I)  LE  18)),P(I,T))  =L=  SUM( J?( ( ORD( J) 

$on:text 

FEAS19(T)$((0RD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUM(I$((ORD(I)  LE  19)),P(I,T))  =L=  SUM( J$( (ORD( J) 
FEAS2C(T)$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARDfT))).. 

SUM(I$((ORD(I)  LE  20)),P(I,T))  =L=  SUM( J$( (ORD( J) 
FEAS21(T)$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUM(I$((ORD(I)  LE  21)),P(I,T))  =L=  SUM( J$( (ORD( J) 
FEAS22(T)$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUM(I$((ORD(I)  LE  22)),P(I,T))  =L=  SUMf J$( (ORD( J) 
FEAS23(T)$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUM(I$((ORD(I)  LE  23)),P(I,T))  =L=  SUM( J$( (ORD( J) 
FEAS24(T)Sf (ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUM(IS((ORD(I)  LE  24)),P(I,T))  =L=  SUM( J$( ( ORD( J) 
FEAS25(Tl$(CORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUMCI5((ORD(I)  LE  25)), PCI, T))  =L=  SUM( J$( (ORD( J) 
FEAS26(T)$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUH(I$((ORD(I)  LE  26)),P(I,T))  =L=  SUM( J$( ( ORD( J ) 
FEAS27(T)$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUMCI$((ORDCI)  LE  27)),P(I,T))  =L=  SUM( J5((ORD( J) 
FEAS28(T)$((ORD(T)  GE  2)  AND  (ORD(T)  LT  CARD(T))).. 

SUM(I$((ORD(I)  LE  28)),P(I,T))  =L=  SUM( J$( (ORD( J) 
SOFFTEXT 

RFEASl(T)$(ORD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  EQ  CARD(I)) ,P(I,T))  =L= 

SUM(J5(ORD(J)  GE  CARD( J)-l) ,P( J,T-1))  ; 
RFEAS2(T)$(ORD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-1),P(I,T))  =L= 

SUMC J$(ORD( J)  GE  CARD( J)-2) ,P( J,T-1))  ; 
RFEAS3(T)$(ORD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-2),P(I,T))  =L= 

SUMC JSCORDC J)  GE  CARDC J) -3) , PC J ,T- 1 ) )  ; 
RFEAS4CT)$C0RDCT)  GE  ULTRA).. 


LE  19)),PCJ,T-1)); 

LE  20)),PCJ,T-1)); 
LE  21)),PCJ,T-1)); 
LE  22)),PCJ,T-1)); 

LE  23)),PCJ,T-1)); 

LE  ^4-))  ,PCJ,T-1)); 

LE  25)),PCJ,T-1)); 

LE  26)),PCJ,T-1)); 

LE  27)),PCJ,T-1)); 
LE  28)),PCJ,T-1)); 

LE  29)),PCJ,T-1)); 


SUMCISCORDCD  GE  CARDC  I ) -3)  ,PC  I  ,T) )  =L= 


SUM(J$(ORD(J)  GE  CARD(J)-4),P(J,T-1))  ; 

RFEAS5(T)$(0RD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-4),P(I,T))  =L= 

>  SUM( J$(ORD(J)  GE  CARD(J)-5) ,P(J,T-1))  ; 

RFEAS6(T)$(0RD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-5),P(I,T))  =L= 
SLT1(J$(0RD(J)  GE  CARD(  J)-6)  ,P(  J,T-1))  ; 

RFEAS7(T)$(0RD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-6),P(I,T))  =L= 
SU.M(J$(ORD(J)  GE  CARD(J)-7),P(J,T-1))  ; 

RFEAS8(T)$(0RD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-7),P(I,T))  =L= 
SUMUSCORDCJ)  GE  CARD(  J)-8)  ,P(  J,T-1) )  ; 

RFEAS9(T)$(ORD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-8),P(I,T))  =L= 
SUM(J$(ORD(J)  GE  CARD(J)-9),P(J,T-1))  ; 

RFEAS10(T)$(ORD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-9),P(I,T))  =L= 
SUM(JS(ORD(J)  GE  CARD( J) -10) ,P( J,T- 1) )  ; 

RFEAS11(T)$(0RD(T)  GE  ULTRA).. 

SUM(IS(ORD(I)  GE  CARD(I ) - 10) ,P( I ,T) )  =L= 
SUM(JS(ORD(J)  GE  CARD(J)-ll) ,P( J,T-1) )  ; 

RFEAS12(T)$(ORD(T)  GE  ULTRA).. 

SUM(IS(ORD(I)  GE  CARD( I ) - 1 1 ) ,P( I ,T) )  =L= 
SUM( JS(ORD(J)  GE  CARD( J) - 12) , P( J ,T- 1 ) )  ; 

RFEAS13(T)S(0RD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-12),P(I,T))  =L= 
SUM(J$(ORD( J)  GE  CARD(J)-13),P(J,T-1))  ; 

RFEAS14(T)$(0RD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-13),P(I,T))  =L= 
SUM( J$(ORD( J)  GE  CARDU)-14),P(J,T-1))  ; 

RFEAS15(T)$(ORD(T)  GE  ULTRA).. 

SU.M(I$(ORD(I)  GE  CARD(I)-14),P(I,T))  =L= 
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SUM(J$(ORD(J)  GE  CARD(J)-15),P(J,T-1)) 
RFEAS16(T)$(0RD(T)  GE  ULTRA).. 

SUM(I$(ORDCI)  GE  CARD(I)-15),P(I,T))  =L= 
SUM( J$(ORD( J)  GE  CARD(J)-16) ,P(J,T-1)) 
RFEAS17(T)$(0RD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-16),P(I,T))  =L= 
SUM(J$(ORD(J)  GE  CARD(J)-17),P(J,T-1)) 
RFEAS18(T)$(0RD(T)  GE  ULTRA).. 

SUM(I$CORD(I)  GE  CARD(I)-17),P(I,T))  =L= 
SUM(J$(ORD(J)  GE  CARD(J)-18),P(J,T-1)) 

CONTEXT 

RFEAS19(T)$(ORDCT)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-18),P(I,T))  =L= 
SUM(J$(ORD(J)  GE  CARD(J)-19) ,P(J,T-1)) 
RFEAS20(T)$(ORD(T)  GE  ULTRA).. 

SU.M(I$(ORD(I)  GE  CARD(I)-19),P(I,T))  =L= 
SUM(J$(ORD(J)  GE  CARD(J)-20),P(J,T-1)) 
RFEAS21(T)$(ORD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-20),P(I,T))  =L= 
SUM(JS(ORD(J)  GE  CARD( J)-21) ,P( J,T-1) ) 
RFEAS22(T)S(0RD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-21),P(I,T))  =L= 
SUM( J$(ORD(J)  GE  CARD(J)-22) ,P(J,T-1)) 
RFEAS23(T)$(ORD(T)  GE  ULTRA).. 

SUM(I5(ORD(I)  GE  CARD(I)-22),P(I,T))  =L= 
SUM(J$(ORD(J)  GE  CARD(J)-23),P(J,T-1)) 
RFEAS24(T)$(ORD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-23),P(I,T))  =L= 
SUM(J$(ORD(J)  GE  CARD(J)-2A),P(J,T-1)) 
RFEAS25(T)$(ORD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-24),P(I,T))  =L= 
SUN(J$(ORD( J)  GE  CARD(J)-25),P(J,T-1)) 
RFEAS26(T)$(ORD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-25),P(I,T))  =L= 


SUM(J$(ORD(J)  GE  CARD(J)-26),P(J,T-1))  ; 

RFEAS27(T)$(ORD(T)  GE  ULTRA).. 

SU.M(I$(ORD(I)  GE  CARDCI)-26)  ,P(I,T))  =L= 

SU.M(JS(ORD(J)  GE  CARD(  J) -27  )  ,P(  J.T- 1) )  ; 

RFEAS28(T)$(0RD(T)  GE  ULTRA).. 

SUM(I$(ORD(I)  GE  CARD(I)-27),P(I,T))  =L= 

SUM( J$(ORD( J)  GE  CARD( J)-28) ,P(J,T-1))  ; 

$OFFTEXT 

MODEL  CSEG  /ALL/  ; 

SOLVE  CSEG  USING  LP  MAXIMIZING  V  ; 

SONTE.XT 

DISPLAY  statements  show  values  of  p,  v  and  z  in  LP  solution 
SOFFTEXT 
DISPLAY  P.  L  ; 

DISPLAY  V.  L  ; 

DISPLAY  Z.  L  ; 

?CNTEXT 

q(i,t)  solution  comes  from  dual  -  network  equation  slack  values 
$OFFTEXT 
PiiRAMETER 

Q(I,T)  evader  marginals; 

Q(I,T)  =  100*(NETL.  M(I,T)+NETE.M(I,T)+NETM. M(I,T)); 

DISPLAY  Q  ; 

$ONTEXT 

u(i,t)  computes  the  maximum  score  obtainable  to  the  searcher  if 
he  is  in  cell  i  and  evader  marginals  are  given 
SOFFTEXT 
PARAMETER 

ZE(I,T)  longest  path  by  searcher; 

ALIAS  (T,TP); 

ZE(I,T)$(0RD(T)  EQ  1)=SUM(TP$(0RD(TP)  EQ  CARD( T) ) ,Q( I ,TP) ) 

L00P(T$(0RD(T)  LT  CARD(T) ) , ZE(I ,T+1)=SUM(TP$( 0RD(TP)+0RD(T)  EQ  CARD(T)), 

Q(I,TP))+MAX(ZE(I-1,T),ZE(I,T),ZE(I+1,T))); 

DISPLAY  ZE; 
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